12/29/2005 10:45 



1201226924B 



CHA REITER 



FACSIMILE TRANSMISSION 
TO THE UNITED STATES PATENT AND TRADEMARK OFFICE 



TO: EXAMINER: Paula Kahn 

FAX NUMBER: 571-273-0300 
SERIAL NUMBER: 09/922,142 
DOCKET NUMBER: US010358 v 



ART UNIT: 2613 



FROM: Steve Cha, Esq. 

CHA & REITER 

210 ROUTE 4 EAST, SUITE 103 

PARAMUS,NJ 07652 

TELEPHONE: (201) 226-9245 
FAX NUMBER: (201)226-9246 




MESSAGE: 



,i Attached is a revised Appeal Brief 



• K 
. I;' 



I certify that this document consisting of \% pages (including this cover sheet 
Being transmitted via telecopier to the United States Patent and Trademark Office at the 
Telephone number set forth above on December <&.£DC$ 




12/29/2005 .jl0:45 12012269246 



CHA REITER 



PAGE 02/18 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE- 
Before the Board of Patent Appeals and Interferences V 

3- 




In re the Application 
Inventor 



Application No. 

Filed 

For-- 



Yong Yan 



09/922,142 
August 3, 2001 

AUTOMATED MASK SELECTION IN OBJECT 
BASED VIDEO ENCODING 



APPEAL BRIEF 
On Appeal from Group Art Unit 




Russell Gross 
Registration No. 40,007 



Date: March 14, 2005 



By: Steve Ch a 
Attorney for Applicant 
Registration No. 44,069 



Certificate of Mailing Under 37 CFR 1.8 



I hereby certify that this correspondence is being deposited with the United States Postal .i • • 

Service as first class mail in an envelope addressed jo the COMMISSIONER FOR PATENTS, Mail Swd ^ ' 
Appeal, P.O. BOX 1 450 ALEXANDRIA, VA 223] 3 on. March '] 4,2005 ^ * 'Jrl^ 

1 Mk$ 



Steve S. Cha. Rep. No. U nm 
(Name of Registered Representative) 




12/29/2005 10:45 12012269246 



. t '/ CHA..REITER 



TABLE OF CONTENTS 




Serial No,: 09/92; 




: PageW 

I. REAL PARTY IN INTEREST , ■ '•■^^ 

• i 

n. RELATED APPEALS AND INTERFERENCES .J * * ^3: 

HI. STATUS OF CLAIMS ' U 

IV. STATUS OF A1MnDM¥nTS~ 7.77.7. ........ .777.7:. '.. . .7. . : 

----- - •• , ' - * -*■■„ . 

" V. SUMMARY OF THE CLAIMED SUBJECT MATTER.. 4 

VI. GROUNDS OF REJECTION TO BE REVIEWED ON Affi 

APPEAL 5 

VII. ARGUMENT 5 

VIII. CONCLUSION u 

IX. CLAIMS APPENDIX 

X. EVIDENCE APPENDIX 17 

XI. RELATED PROCEEDINGS APPENDIX \1 

- 

TABLE OF CASES . ' ^ Ji^ 
Lindemann Maschinenfabrik GmbH v. American Hoist & Derrick Co., 4 ; Jf '' ,-. 

221 USPQ 481, 485 (Fed. Cir. 1984) \ j 7 >^ 

Smithkline Diagnostics, Inc., v. Helena Labs Corp., * 

59 F.2d 878, 887, 8 USPQ 2d 1468, 1475 (Fed. Cir. (1988) 9 

In re Royka, 490 F. 2d 981 , 180 USPQ 580 (CCPA 1975) 1 1 

i7 

2 it • 



12/29/2005 10:45 12012269246 



CHA REITER 



PAGE 04/18 



I Serial No.: 0^2,^ 



I. REAL PARTY IN INTEREST 



5 j . 

The real party in interest is the assignee of the present application, f U:S 
Corporation, and not the party named in the above caption, 




II- RELATED APPEALS AND INTERFERENCES 



» .l!Al--IJ J ' 



P-v; 

With regard to identifying by number and filing date all other appeals or 
interferences known to Appellant which will directly effect or be directly affected bytor. 
have a bearing on the Board's decision in this appeal, Appellant is not aware of any such 
appeals or interferences. 



III. STATUS OF CLAIMS : '^m& 



Claims 1-28 have been presented for examination. All of these claims are * ' JSp* i: 



pending, stand finally rejected, and form the subject matter of the present appeal. ^^SHP" 

IV. STATUS OF AMENDMENTS 

The Amendment after the Final Office Action containing claims 1-28 filed' 
November 12, 2004 has been entered. ' :: ' " vl ^ °' 

A first Office Action was mailed on March 3, 2004. Claimsl-5, 7-15,' 17?24 and 1 ' 
26-2$ were rejected under 35 USC § 102(e) as being anticipated by Chen (U$P no. 
6,208,693). Claims 6, 16, and 25 were rejected under 35 USC 1 03(a) as being obvjquif • 
over Chen in view of Sekiguchi (USP no '.* 6,61 1,628). On June 28, 2004, a rcsponse^tefe 
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the first Official Action was filed which presented arguments why the references ij^j^d ..; 

. V,! ' : * 

failed to anticipate or render obvious the claimed invention. No amendments were jnade j 
to the claims. On September 28, 2004, a second and Final Office Actions was entered, ' 
which again rejected claims 1-5, 7-15, 17-24 and 26-28 as being anticipated by Chen and 
claims 6, 16 and 25 were rejected as being obvious in view of the combination of Chgn 
and SekiguchL A Response After Final Office Action was filed on November 10, : 200^4, ,; 
whieh presented- additionat~arguments^^^ 



page; fio.'m 

anticipated or rendered obvious by the recited references. No amendments were made to 
the claims. An Advisory Action, having a mailing date of December 29 2004^)was^ f ; ' 
'entered into the file and stated that the arguments did not place the application in 
condition for allowance. A Notice of Appeal, with appropriate fee, was fil^on?mul^r ' 
12,2005. ' * m >vi 

V. SUMMARY of the CLAIMED SUBJECT MATTER 
The present invention provides a method and a system for dynamically selecting a ' 

'-> 

mask type (Figure 1 , items 17, 19, 21) based on characteristics such as coded shape, = 
texture and motion information of an object in an image (see page 3, line 1 8- page 4; l'ine^ 

f. 

3). In a one aspect, the invention provides a video object encoding system (Figure 1*^ ^ 
item 1 0), comprising an object evaluation system (Figure 1 , iteml2) that evaluates tp 
video object using a predetermined criterion and a mask generation system (Figure' ?/ W ^> 
item 14) that generates one of a plurality of mask types (Figure 1, items 17, 19, 2V)tox 
the video object (Figure 1 , item 27) based on the evaluation of the video object (see page y 
4, lines 7-16). In order to capture video objects in the alpha plane for encoding, shape 
masks are used that match or approximate the shape of the object The mask generation 
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system may select the mask used from mask types such as; a pixel-based mask (Figure 1, 
iteirt.17) that is an arbitrary shape closely matching the object on a pixel level; a bqundij|g 
box (Figure 1, item 19) that bounds the object shape (e.g., a rectangle); or a macrpbtock* > £ 
based mask (Figure 1, item 21). (see page 4, lines 7-23). 

■ • ■■■ - 

VI. GROUNDS of REJECTION to be REVIEWED ON APPEAL 

The issues in the present matter are whether: [ { ^ 

1. claims 1-5,7-15; "17-2* affl^^ 
Chen; and 

2. claims 6, 16 and 25 are obvious under 35 USC § 103(a) in view of the 
combination of Chen and Sekiguchi. 

VIL ARGUMENT [ 

> L Rejection of Claims 1-5, 7-15. 17-24 and 26 Under 35 USC Slfiffl 

in view of Chen iti n k- 

Claims 1-5, 7-15, 17-24 and 26-28<stand rejected under 35 USC §102(e) as being* ; 

anticipated by Chen (USP No. 6,208,693). The Final Office Action states that all of 

elements of the claimed invention are disclosed by Chen. 

Difference Between the Claimed Invention 
and the Primary Reference - Chen 

The instant invention, as recited in claim 1, which is typical of the remaining 

independent claims, discloses an encoding system, comprising an object evaluation 

system that evaluates a video object using a predetermined criterion and a mask 

generation system that generates one of a plurality of mask types for the video object ^ 

based on the evaluation of the video object. 
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' ' • ' ^i'; ... ■ ; i 

Chen discloses a system for encoding video objects by first defining a bounding / .■ i 
box and then determining the shape of the video obj 

specifically, Chen states that the "shape mask generator 249 compares each pixel value 
(in the reconstructed pixel signal) [in the bounding box] to the chroma-key value (or,a . 
range of values near the chroma-key color). By comparing the pixels values to the 
I chroma-key value the shape mask generator 249 can determine which pixels axe located v 
within the object and which pixels'^ 

original shape of the object in the VOP " (see col. 6, lines 37-44). 

The process of Chen is more fully disclosed with regard to Figure 5, which'M^eB^'t 
illustrates a flow chart of the operation of an encoding system according to an 
embodiment of the Chen device. Chen further discusses the operation of the process 
col. 9, lines 54-col. 10, line 57. More specifically, at step 510 a video frame is receive^ ' ' ■ 
and at step 515 a bounding box is created around the video object. "At step 525, witiiin 
the bounding box, each macroblock formatted [sic] and is identified as either: 1) outsike 
the video object; 2) inside the object; or 3) on the object boundary." Accordingly, Chen 
uses a bounding box to isolate the object and then determines the shape of the object^y ' 
evaluating the object within the bounding box. * ' ' 1 ' 1 : ; 

Chen Fails to Anticipate the Claimed Invention 
The Final Office Action in rejecting th? claims states that "the 'mask generation', 
Chen's col. 6, line 47-52, (which state, in part,"[a]lso, color extractor and shape mask 
generator 249 generates and outputs a shape mask identifying the shape of the video H Ui 
object. The shape mask can be generated as a binary map ... or a gray scale map 4 * ^ 
identifying whether each pixel is either inside or outside the video object") discloses that 
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masks can be generated for the video object based on the position of the location of the 
pixel relative to the video object." \ \ 

£ - "Anticipation requires the presence in a single prior art reference disclosure, of 
each and every element of the claimed invention, arranged as in the claim" Lindemann i 1 



Maschinenfabrik GmbH v. American Hoist & Derrick Co.. 221 USPQ 481. 48£(RedL \3*'^- 
Cir. 1984) (emphasis added). 

Contrary to the positi^ 
each and every element recited in claim 1 . As noted above, Chen teaches a system for 
generating the shape mask as the object shape within a bounding box that isolates the 
object from the other objects in the image. 

Chen fails to teach "a mask generation system that generates one of a plurality of 
mask types for the video object based on the evaluation of the video object," as is recited 

'*V - A 

in claim 1, Hence, rather than evaluating the object to determine the type of mask, Chen 
teaches using a bounding box and generating the object shape within the isolating box '* 
based on evaluating the object. Nowhere does Chen disclose generating "one of a * : 1 \ 
plurality of mask types based on the evaluation of the object" as is recited in claim L 

Accordingly, Chen cannot be said to anticipate the invention recited in claim 'f as 
Chen fails to disclose each and element claimed. 

In. view of the above, applicant submits that claim 1 is patently distinguishable 
and patentable over the teaching of Chen, 

With regard to independent claims 1 1 and 20, these claims recite subject matter ' 
similar to that recited in claim 1 and have been rejected for the same reason used to reject 
claim 1. However, claims 1 1 and 20 each disclose the element "a mask generation * { fl 
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system that generates one of a plurality of ihask types for the video object based on the . ■ ' 
' evaluation of the video object," which is recited in claim 1. Accordingly, claims U^jj| 
20 include subject matter not disclosed by Chen and, thus, for the same remarks made V 
with regard to claim 1, which are reasserted, as if in full herein, applicant submits that ; 
these claims are also patently distinguishable and allowable over the teachings of Chen. 
With regard to dependent claims 2-5, 7-10, 12-19, 21-24 and 26-28, these claims 



depend fiom independent claims 1., "1 l~and~2'0; respectively, whicSTiavc been shown to 6eT 
patently distinguishable over the cited reference. Accordingly, these claims are also 

t. 

patently distinguishable and allowable over Chen by virtue of their dependency upon'anv, 
allowable base claims. 

In view of the above, applicant submits that all of the above refeired-to^ 



patentable over the teachings of Chen. 



II. Rejection of claims 6. 16 and 25 Under 35 USC S103(a^ 
in view of Chen and Sekiguchi 

Claims 6, 16 and 25 stand rejected under 35 USC § 103(a) as being obvious in 
view of combination of Chen and Sekiguchi. The Final Office Action states that "Chen 
discloses an object evaluation system . . . using predetermined criterion. . . . Chen does not 
specifically disclose a system . . . wherein the predetermined criterion includes whether 

,.tHull( 

the video object shape is substantially circular. However, Sekiguchi teaches a system 
where the substantial roundness ... of a vidco.dbject shape can be determined. Therefore, 

* * 

it would have been obvious ... to incorporate Sekiguchi's teaching into Chen's video 
encoding system ... for efficiently encoding of image features in an accurate, high quality 
manner." (see Final Office Action, last paragraph, p^ge 9- first paragraph, page 10). 
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Difference Between the Claimed Invention 
and the Cited References 

<! 

i 

? .. . 

\\ 

The present invention, as recited in claim 6, which is typical of the subject matter 
recited in claims 16 and 25, ultimately depends from claim 1 . As remarked above, claim 

1 discloses a system reciting an element for "generating one of a plurality of mask types;" 

✓ 

which CJien fails to teach or disclose, V ;< ; » 

' " Sekiguchi' discloses a feature coding unit that extracts and encodes a feature of a PA ^ 
video signal to generate a feature stream. Tn one embodiment, shown in Figure 2, and 
described, in part, in col. 14, line 46-60, which is refenred-to in the Final Office Action; 1 
Sekiguchi discloses that video content 1 U is provided to a search processor 9 and the 
parameters used by the search processor 9 may include color information, such as 'blue 5 
and 'red', brightness information, relative area of segment, shape information (such as 
s rouT|d J or 'rectangular') of the segment.' 7 

No Motivation Exists for the ' M 

Examiner's Proposed Modification * p h," 

/ 

• - / 

Contrary to the statements made in the Final Office Action, there is no motivation 
to develop the features of the present invention from the teachings of Cheri and 
Sekiguchi. 

The law is clear that there must be some teaching in the reference to support their 

use in the particular claimed combination. See Smithkline Diagnostics, Inc., y. Helena . 

* i 

\ Labs Corp., 859 F.2d 878, 887, 8 USPQ 2d 1468, 1 475 (Fed. Cir. (1988) : 



9 
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As remarked above, Chen discloses isolating a video object using a bounding box 
and detennining the object shape within th£ bounding box by determining which pixels* . ; * * 
' are located within the object and which pixels are located outside the object to idejitiJ^i^ 
the original shape of the object. Sekiguchi discloses providing search criteria to a search^ 
processor that uses the provided criteria to determine the object shape, 

However, nothing in Chen teaches or suggests using criterion other than the 
"object texture (luminance the 7771" 

I bounding box to determine the object shape. 

In fact, the use of a circular criterion in the Chen device would increase the ; . : : A 
processing required to determine the object shape. For example, if the inputted circular 
criteria were used as the bounding box to isolate the object, then additional computations * 
are necessary to determine which set of the primarily square (e,g, 5 1 6x1 6 pixel) ' * " 
macroblocks are contained in the circular boundin g box. Similarly, if the circular criteria 
is used in addition to the textual criteria to determine the object shape, then additional* Ul 
computations are necessary to determine which of the individual macroblocks border the 
object Chen, in Figure 3 ? illustrates the problem of using a circular search criteria in 
referring to a single macroblock with a highlighting circle 320. Hence, a circular 
criterion would encompass areas of surrounding macroblocks which require additional 
processing to remove the surrounding areas. Chen, in Figure 4, illustrates further the 
advantages of using an essentially square or rectangular bounding box as individual 
macroblocks can be evenly encompassed in the bounding box without additional 
computation. 

Accordingly, because the use a circular criterion would increase the ' '' ' : ' ' ,a 

. I 

10 
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computational requirements of the processor, one would not be motivated to use a 
circular search criterion as suggested in the Final Office Action. I 

I Proposed Modification of Chen 

Fails to Arrive at the Present Invention 

To establish a prima facie case of obviousness of a claimed invention, all the 
claim limitations must be taught or sugge$ted'in the prior art. See In re Royka, 490 R 26p^:i ( : " 
.981, 180 USPQ 580 (CCPA 1975). The proposed modification of Chen fails to establish 
a prima facie case of obviousness because, even if there were some motivation to^fcyeto]^ 
the feature suggested by the examiner, all of the claim elements are not taught or 
suggested by the combination of the teachings of the cited references. Rather, the 
proposed modification fails to generate "one of a plurality of mask types based on an 

. evaluation of the object," as is recited in the independent claims, as both Chen and 
Sckiguchi are silent with regard to this claim element. 

Accordingly, the combination of Chen and Sekiguchi cannot be said to render 
obvious the invention recited in claim 6, as both Chen and Sekiguchi fail to recite an 
element recited in the independent claim 1 from which claim 6 depends. ' • - u 

Alternatively, even if the teachings of Chen and Sekiguchi can be combined it can 
be shown that the combined device would not operate as is claimed. For example, if a^' ^ 
circular search criteria were selected by the device of Sekguchi, and a circular object 
were extracted from a video image by the device of Chen, the combined device would not 
generate a mask type based on the evaluation of the video object performed by Sekiguchi. 

s Rather, the bounding box is selected independent of the search criteria. 



n 
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In view of the above remarkspqiplicant submits that claim 6 is not rendered 

r 

obvious and patentable over the teachings of Chen and Sekiguchi, - ; 

J- .... ,4^4 V- "-iV 3 

With regard to claims 16 and 5,pese claims were rejdctea^itiiig tfiels 



disclosed by the combined device of 



'reason used to reject claim 6. Howe\ r, fflaims 16 and 25 recite the 'same subjl 
that is recited in claim 6, According! 



cguros 16 and 25 also include subject matt 




he| and Sekiguchi and, thus, for the same remarks; ) 

,| ' _ _ 

made with regard to claim 6, cannot m said to have been rendered obvious as suggested / 

in the Final Office Action. 

In view of the above, applicant submits that claims 6, 16 and 25 are patentable .v. , ! 



over the teachings of the cited references. 

For at least all of the above reasons, the proposed combination of prior art 
references would not have rendered obvious the present invention. 



VnL CONCLUSION 



In view of the above analysis, it is respectfully submitted that the referenced 
teachings, whether taken individually or in combination, fail to anticipate or render 
obvious the subject matter of any of the present claims. Therefore, reversal of all 
outstanding grounds of rejection is respectfully solicited. 

Respectfully submitted, 

Russell Gross 
Registraticm No. 4Q,007 



Date: March 14, 2005 




By: 

Attorney for Applicant 
Registration No. 44,069 
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IX. APPENDIX: THE CLAIMS ON APPEAL 

1 . A video object encoding system, comprising: 
i. an object evaluation system that evaluates a video object using a predetermined 

criterion; and 

a mask generation system that generates one of a plurality of mask types fqf the ; v ° 

video bbjecf b^ed ori^the ev^uation ^~ 

* - • — - - - — pag:: i * -"1" 

2. The video object encoding system of claim 1 , wherein the plurality of mask types 
includes a pixel-based mask, a bounding box mask, and a macroblock-bascd mask, r 1 

3. The video object encoding system of claim 1, wherein the predetermined criterion 
examines a shape of the video object. 

4. !\ The video object encoding system of claim 1, wherein the predetermined criterion 
examines a texture of the video object. 

5. |he video object encoding system' of claim 1 , wherein the predetermined criterion ' 
examines motion information regarding the video object. 

6. The video object encoding system of claim 3, wherein the predetermined criterion'' 
includes whether the video object shape is substantially circular. 

7. The video object encoding system of claim 3, wherein the predetermined criterion 
includes whether an area of the video object shape is substantially similar to an area of a 
generated bounding box. 

8. The video object encoding system of claim 7, wherein the predetermined criterion 
includes whether an area of a tnacroblock-based shape generated for the video object is 
substantially similar to the area of the generated bounding box. 



13 
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9. The video object encoding system of claim 8, wherein the predetermined criterion 
includes whether the area of a macroblock-^ased shape is larger than the area of the video 
object shape. - * 11 5 

10. The video object encoding system of claim 1, further comprising an MPECSM- 1 
encoder. 

1 L A program product stored on a recordable medium, which when executed, encodes 
video objects, the program product comprising: 

prbgram code configured to evaluate a video object using a predetermined criterion; and 
program code configured to generate one of a plurality of mask types for the video object 
baseid on the evaluation of the video object. 

12. The program product of claim 1 i , wherein the plurality of mask types includes a 
pixel-based mask, a bounding box mask, and a macroblock-bascd mask. : * ^ ' 

! 3 . The program product of claim ] 1 , wherein the predetermined criterion examines a 
shape of the video object ; 

14. The program product of claim 11, wherein the predetermined criterion examines a 
texture of the video object. 

15. The program product of claim 1 1 5 wherein the predetermined criterion examines 
motion information regarding the video object, 

16. The program product of claim 13, wherein the predetermined criterion includes * ' 
whether the video object shape is substantially circular. 

1 7. The program product of claim 13, wherein the predetermined criterion includes 
whether an area of the video object shape is' substantially similar to an area of a generated 

♦ 

bounding box. : ' 



14 
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.1.8, The program product of claim 17, wherein the predetermined criterion includes 
whether an area of a macroblock-based shape generated for the video object is 
substantially similar to the area of the generated bounding box. 
I 1 9. The program product of claim 1 8, wherein the predetermined criterion includes 

whether the area of a macroblock-based shape is larger than the area of the video object 
shape. 

20. A method, for encoding" video" objcctTiF^ "* r ^~" 
system, comprising the steps of; 

evaluating a video object using a predetermined criterion; and = ■ v \ » 

generating one of a plurality of mask types for the video object based on the 
evaluation of the video object. 

21 . The method of claim 20, wherein the plurality of mask types includes a pixel-based 

mask, a bounding box mask, and a macroblock-based mask. 

'i 

22. The method of claim 20, wherein the predetermined criterion examines a shape of 
the video object. 

23. The method of claim 20, wherein the predetermined criterion examines a texture of 
the video object. 

i 

'*."-*■ *• . * f 

24. The method of claim 20, wherein the predetermined criterion examines motion 
information regarding the video object. 

25. The method of claim 22, wherein the evaluating step includes determining if the 
shape is substantially circular. 

26. The method of claim 22, wherein the evaluating step includes: 
■ \ generating a bounding box; and 
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$ 

determining if an area of the object shape is substantially similar to an area of 

*. 

the generated bounding box. 

27. The method of claim 26, wherein the evaluating step includes: 

t 

generating a macroblock-based shkpe; and 

determining whether an area of the macroblock-based shape is substantially , 
similar to the area of the generated bounding box. 

28. The method of claim 27, wherein the evaluating step includes determining-whether 

the area of a macroblock-based shape is larger than the area of the object shape. 



16 
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X. EVIDENCE APPENDIX 

No supplemental evidence waf provided by'appellant that was enteireBlml^p 
record during the prosecution of this mattir. | 
XI. RELATED)PROCEEDING APPENDIX • j 

No related proceedings are pe|dir|g and, hence, no information regarding same is 

t 

available. 
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